A Method for Camera-Based Interactive Whiteboard Reading
نویسندگان
چکیده
Recognizing mind maps written on a whiteboard is a challenging task due to the unconstrained handwritten text and the different graphical elements — i.e. lines, circles and arrows — available in a mind map. In this paper we propose a prototype system to recognize and visualize such mind maps written on whiteboards. After the image acquisition by a camera, a binarization process is performed, and the different connected components are extracted. Without presuming any prior knowledge about the document, its style, layout, etc., the analysis starts with connected components, labeling them as text, lines, circles or arrows based on a neural network classifier trained on some statistical features extracted from the components. Once the text patches are identified, word detection is performed, modeling the text patches by their gravity centers and grouping them into possible words by density based clustering. Finally, the grouped connected components are recognized by a Hidden Markov Model based recognizer. The paper also presents a software tool integrating all these processing stages, allowing a digital transcription of the mind map and the interaction between the user, the mind map, and the whiteboard.
منابع مشابه
A New Kind of Position Location Sensor Based on Encode and the Application Research
This paper proposed a plane position detection method based on coding identification, discusses key problems to be solved in design of interactive electronic whiteboard with this method, gives structure and optical path design method of pen-based sensing system, discusses plane position coding method, comes up with solutions of coding of discontinuous code area and incremental coding of continu...
متن کاملTowards Automatic Video-based Whiteboard Reading
As whiteboards have become a popular tool in meeting rooms, there has been a growing interest in making use of the whiteboard as a user interface for human computer interaction. Therefore, systems based on electronic whiteboards have been developed in order to serve as meeting assistants for e.g. collaborative working. However, as special pens and erasers are required, the natural interaction i...
متن کاملConsider the details: A Study of the Reading Distance and Revision Time of Electronic over Dry-Erase Whiteboards
Electronic whiteboards are replacing dry-erase whiteboards in many contexts. In this study we compare electronic and dry-erase whiteboards in emergency departments (EDs) with respect to reading distance and revision time. We find inferior reading accuracy for the electronic whiteboard at all three levels of distance in our study. For revision time, the electronic whiteboard is slower on one sub...
متن کاملFuzzy Rule-based Dynamic Gesture Recognition Employing Camera & Multimedia Projector
In the paper the system based on camera and multimedia projector enabling a user to control computer applications by dynamic hand gestures is presented. The main objective is to present the gesture recognition methodology which bases on representing hand movement trajectory by motion vectors analyzed using fuzzy rule-based inference. The approach was engineered in the system developed with J2SE...
متن کامل